Joint audio-video object tracking
نویسندگان
چکیده
This paper presents a object localization and tracking algorithm integrating audio and video based object localization results. A face tracking algorithm and a microphone array are used to compute two single-modality speaker position estimates. These position estimates are then combined into a global position estimate using a decentralized Kalman filter. Experiments with a model railway show that such an approach yields more robust results for audio-visual object tracking than either modality by itself.
منابع مشابه
Object Localization by Joint Audio-Video Signal Processing
There are many di erent approaches either for the localization of sound sources or for tracking of visible objects in image sequences. However, most applications use only one modality, that is, they process only audio or video information for object localization. In this paper we introduce a method for the estimation of object positions based on joint audio-video information. The key technique ...
متن کاملSpeaker Tracking Using an Audio-visual Particle Filter
We present an approach for tracking a lecturer during the course of his speech. We use features from multiple cameras and microphones, and process them in a joint particle filter framework. The filter performs sampled projections of 3D location hypotheses and scores them using features from both audio and video. On the video side, the features are based on foreground segmentation, multi-view fa...
متن کاملMultiple Human Tracking with Wireless Distributed Pyroelectric Sensors
This paper presents a wireless distributed pyroelectric sensor system, whose sensing visibilities are modulated by Fresnel lens arrays, for tracking multiple humans. The aim of this study is to design and develop a wireless infrared sensor system which can track multiple humans with better data-to-object association, lower power consumption/cost/detectability, and less privacy infringement than...
متن کاملAn Efficient Target Tracking Algorithm Based on Particle Filter and Genetic Algorithm
In this paper, we propose an efficient hybrid Particle Filter (PF) algorithm for video tracking by employing a genetic algorithm to solve the sample impoverishment problem. In the presented method, the object to be tracked is selected by a rectangular window inside which a few numbers of particles are scattered. The particles’ weights are calculated based on the similarity between feature vecto...
متن کاملJoint audio-video object localization using a recursive multi-state multi-sensor estimator
Object localization based on audio and video information is important for the analysis of dynamic scenes such as video conferences or traffic situations. In this paper, we view the the dynamic audiovideo object localization problem as a joint recursive estimation problem. It is solved using a decentralized Kalman filter fusing both audio and video position estimates. To better take into account...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2001